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APPENDIX D 
GREAT CIRCLE CALCULATIONS 


A simple and direct method of performing the great-circle calculations required in 
siting line-of-sight and scatter communication stations is presented here. An under- 
standing of how the method is derived is not needed. 


The calculation of the great-circle path length and azimuths between the transmitter 
and the receiver sites can be easily made if the latitudes and longitudes of the sites 
are known. Usually these coordinates can be obtained with sufficient accuracy from 
reliable maps of the areas involved. It is worthwhile for two persons to make the 
computations independently, comparing their results after each step. If only one per- 
son is making the computations, he should check each step thoroughly as it is com- 
pleted. The computations require the addition, subtraction, multiplication, and divi- 
sions of positive and negative numbers and the use of tables of functions. 


An accuracy of two minutes of arc is usually adequate for the great-circle calculations 
needed in siting line-of-sight scatter communication stations. This accuracy can be 
obtained by using five-place tables of logarithms and trigonometric functions. The 
tables should be graduated for every minute or every one-hundredth of a degree of arc. 
If five-place tables are used, it is recommended that six decimal places be carried in 
performing the arithmetical operations of the great-circle calculations and that inter- 
polation be used to obtain all functions to six places and all angles to the nearest tenth 
of a minute or one-thousandth of a degree of arc. The computed azimuths should then 
be rounded to the nearest minute or one-hundredth of a degree of are and the path 
length should be rounded to one decimal place, although the last digit will not always 
be significant. 


The procedure presented here requires the uniform system of nomenclature shown in 
figure D-1. The location having the more westerly longitude is designated point A and 
the location having the more easterly longitude as point B. The North Pole is always 
used as the third point of the terrestrial triangle, regardless of the latitude of point A 
or B, and is designated as P. 


The equations upon which the great-circle computations are based are the law of 
cosines. In terms of the terrestrial triangle PAB shown in figure D-1, these are 


sin Asin P_ sinB 


D- 
sina sinp. sinB ey) 


and 
cos p = cos a cos b + sin a sin b cos P (D-2) 


where equation (D-1) is the law of sines and equation (D-2) is the law of cosines. Since 
a = (90° - Lat B) and b = (90° - Lat A), equations (D-1) and (D-2) may be rewritten as 
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Figure D-1. Geometry for Great-Circle Calculations 
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cos p = Sin (Lat B) sin (Lat A) 


(D-3) 
+ cos (Lat B) cos (Lat A) cos P 


and 


sin A . Sin E sin B 
cos (Lat B) sinp_ cos (Lat A) 


from which the following equations for sin A and sin B are obtained: 


Sik See eos (tHe By (D-4) 
sin p 


and 


sin B = 22 cos (Lat B) (D-5) 
sin p 


Application of the law of cosines to angles A and B results in the equations 


ae ee sin (Lat B) - cos p sin (Lat A) (D-6) 


sin p cos (Lat A) 


and 


re sin (Lat A) - cos p_sin (Lat B) (D-7) 


sin p cos (Lat B) 


Angle P is equal to the algebraic difference of the longitudes of points A and B; that is, 
angle P = Long A - Long B and can have any value between 0° and 360°. Longitudes 
west of Greenwich are considered to be positive and those east of Greenwich are naga- 
tive. Likewise, latitudes north of the equator are positive and those south of the equa- 
tor are negative. An arc above two capital letters is used to indicate the shorter 
great-circle are between two points on the earth, and the direction of the arc is indi- 
cated by the order in which the capital letters are written. For example, AB repre- 
sents, and is read as, "the shorter great-circle arc from point A to point B." 


For the purpose of this appendix, the azimuth at point A of AB is defined to be the 
angle at A between AP and AB, measured eastward from north. The azimuth at point 
B of BA is defined in a similar manner. These azimuths may have any value between 
0° and 360°. For example, in figure D-1, the azimuth at point A of AB is the interior 
angle A, while the azimuth at point of B of BA is 360° minus the interior angle B. In 
general, these azimuths do not differ by 180°. 


Angles A and B are special angles introduced to simplify the computation of azimuth. 
They are positive angles between 0° and 90° and are, by definition, equal to the values 
of angles A and B respectively, when these latter angles are obtained directly from 

the tables without regard to quadrant. Use of the trigonometric tables is thus simpli- 
fied and large angles need not be dealt with until the last steps of the computation. For 
example, if sin A = -0.5, then A = 30°, not -30°, Similarly, if cos B= 0.5, then 

B = 60°, not 120°. The computation of both the sines and cosines of angles A and B 
from equations (D-4), (D-5), (D-6), and (D-7) allows the formulation of rules for the 
summarized in the tables below and on the computation forms. 
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Two examples are given, using forms especially designed to facilitate the computa- 
tions. One illustrates the use of five-place tables of logarithms, the other a calculat- 
ing machine (figure D-2 and figure D-3). The latter is also applicable if it is neces- 
sary to make the calculations by longhand (see figure D-4). If accurately followed, 
the indicated procedures will automatically eliminate any ambiguity in the quadrant of 
angles computed. 


A typical computer program which may be used in great-circle calculations is shown 


in figure D-5. This program has been developed by the INFONET Division of Compu- 
ter Sciences Corporation and it is reprinted here with their permission. 
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Figure D-4. 


Great-Circle Calculations (Sheet 2 of 3) 


AlAA228 


MAY 1972 


NAVELEX 0101,112 


Azimuth from Site 


Azimuth from Site 


° x 69.093 = (Statute Miles) 


Figure D-4. Great-Circle Calculations (Sheet 3 of 3) 
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*** SPHERE 
SPHERICAL TRIANGLES 
Geometry 02.03 


Program No. 01-0640 


ABSTRACT ***SPHERE solves spherical triangles having an apex at the 
North Pole and the other two corners defined by their respective 
latitudes and longitudes. Program output includes great circle 
distances, true bearings, and the hour angle at the North Pole. 


DESCRIPTION ***SPHERE solves spherical triangles having an apex at the 
North Pole. Input consists of: 


e Local latitude and longitude 
e@ Remote latitude and longitude 
e Observed altitude, if any 
Output consists of: 
e Local hour angle at the North Pole 
Zenith (great circle) distances 
True bearings (great circle courses) 


Altitude (remote celestial position above the local 
horizon) 


e Line of position 


INSTRUCTIONS After the program description has printed, enter input data in the 


following format: 


10 DATA LTD, LTM, LGD, LGM, RLTD, RLTM, RLGD, 
RLGM, ALD, ALM 


E00004-00.016-00 ©1970 Computer Sciences Corporation 
Los Angeles, California 
Printed in U.S.A. 


Figure D-5. Great-Circle Distance,Computer Program (Sheet 1 of 5) 
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***SPHERE 


SPHERICAL TRIANGLES 


SAMPLE RUN 


Figure D-5. 
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LTD, LTM = local latitude (degrees, minutes) 

LGD,LGM = local longitude (degrees, minutes) 

RLTD, RLTM = remote latitude (degrees, minutes) 

RLGD, RLGM = remote longitude (degrees, minutes) 

ALD, ALM — = observed altitude (if any) (degrees, minutes) 


Each pair of numbers specifies the. degrees and the minutes of each 
associated location. 


For South latitudes and East longitudes, enter the degree values 
as negative numbers. If there is no observed altitude, set ALD and 
ALM equal to zero. 


The first DATA statement used must be numbered 10. DATA for 
as many cases as desired can be entered successively in succeeding 
DATA statements. DATA statements can be numbered 10-99. 


After all DATA statements have been entered, type RUN 
(followed by a carriage return) and program execution will continue. 


To re-execute the program, enter the desired new DATA statements 
and type RUN again. 


Solve the spherical triangle problem using the following data: 
Local Latitude: 40 degrees 50 minutes North Latitude 


Local Longitude: 73 degrees 30 minutes West Longitude 


Remote Latitude: 23 degrees 26 minutes North Latitude 


Remote Longitude: 133 degrees 30 minutes West Longitude 


Observed Altitude: 37 degrees 20 minutes 


£00004-00.016-00 
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***SPHERE 
SPHERICAL TRIANGLES 


RUN +***sSPHERE 
***eSPHERE 11339 05/12/70 


SQ@LUTION OF SPHERICAL TRIANGLES 
#017-06403 VERSION 2 


DETAILS CYESsN@) 7YES 


***SPHERE SOLVES SPHERICAL TRIANGLES HAVING THE 
APEX AT THE NORTH POLE AND THE @THER TWO CORNERS DEFINED 
BY THEIR RESPECTIVE LATITUDES AND L@ONGITUDES- 
MULTIPLE CASES MAY BE ENTERED SUCESSIVELY IN DATA 
STATEMENTS 10-999 IN THE FOLLOWING FORMATS 


10 DATA LTDsLTMs LGDsLGMs RLTDsRLTMs RLGDsRLGMs ALDsALM 


WHERE EACH PAIR @F NUMBERS SPECIFIES A L@CATION IN THE FORM 
*DEGREES»MINUTES® AS FOLLOWS: 


LTD»sLTM LOCAL LATITUDE 

LGDsLGM LOCAL LONGITUDE 

RLTD»RLTM REMOTE LATITUDE 

RLGD»RLGM REMBTE LONGITUDE 

ALDsALM OBSERVED ALTITUDE CIF ANY) 


SOUTH LATITUDES AND EAST LONGITITUDES ARE SPECIFIED 
WITH NEGATIVE DEGREES AND POSITIVE MINUTE VALUES~- 
IF THERE IS NO OBSERVERED ALTITUDE» SET ALD AND ALM 
EQUAL TO ZERO. 


END OF *#**SPHERE 
N@W AT *END* 


11241 RAN 0 MINS 0-32 SECS 


READY 
10 DATA 40250573,305232265133s30,37520 
RUN 


*** SPHERE 11342 05/12/70 


SOLUTION OF SPHERICAL TRIANGLES 
#01-06403 VERSION 2 


E00004-00.016-00 © 1970 Computer Sciences Corporation 
Los Angeles, California 
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Figure D-5. Great-Circle Distance, Computer Program (Sheet 3 of 5) 
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*** SPHERE 
SPHERICAL TRIANGLES 


CASE NUMBER 1 


LOCAL P@SITION: 

40 DEG 50 MIN N@RTH LATITUDE 

73 «DEG 30 MIN WEST LONGITUDE 
REMOTE POSITION: 

23 DEG 26 MIN NORTH LATITUDE 
133 DEG 30 MIN WEST LONGITUDE 
LOCAL H@UR ANGLE CAT NORTH POLE): 

60 DEG 

60 DEG O MIN 

4 HRS O MIN 0 SEC 
ZENITH (GREAT CIRCLE) DISTANCES: 

5206 DEG 

32 DEG 37 MIN 

3157 NAUTICAL MILES 

3635¢5 STATUTE MILES 
TRUE BEARINGS (GREAT CIRCLE COURSES): 
REMOTE P@OSITIGN FROM LOCAL POSITION: 
270¢«1 DEG 

270 DEG 4 MIN 

LOCAL POSITION FROM REMOTE POSITION: 


556 DEG 
55 DEG 33 MIN 


ALTITUDE CREMOTE CELESTIAL POSITION 
ABOVE LOCAL POSITION HORIZON): 


37-4 DEG 
37 DEG 23 MIN 
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Figure D-5. Great-Circle Distance, Computer Program (Sheet 4 of 5) 
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*** SPHERE 
SPHERICAL TRIANGLES 


OBSERVED ALTITUDE: 
37 DEG 20 MIN 


37-33 DEG 


LINE OF POSITION: 


3 MILES AWAY @N LINE BEARING 90-1 DEGREES TRUE 


END OF ***SPHERE 
N@W AT *END* 


11243 RAN O MINS 0612 SECS 


E00004-00.016-00 ©1970 Computer Sciences Corporation 
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Figure D-5. Great-Circle Distance, Computer Program (Sheet 5 of 5) 
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